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ABSTRACT 



In 1990, the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment (TSA) ,* for the first time in the 
NAEP's history, voluntary state-by-state assessments were made. The sample 
was designed to represent the 8th grade public school population in a state 
or territory. In 1996, 44 states, the District of Columbia, Guam, and the 
Department of Defense schools, took part in the NAEP state science assessment 
program. The NAEP 1996 state science assessment was at grade 8 only, although 
grades 4, 8, and 12 were assessed at the national level as usual. The 1996 
state science assessment covered three major fields: earth, physical, and 
life sciences. In Arkansas, 1,858 public school and 89 nonpublic school 
students in 76 public schools and 6 nonpublic schools were assessed. This 
report describes the science proficiency of Arkansas eighth- graders , compares 
their overall performance to students in the Southeast region of the United 
States and the entire United States (using data from the NAEP national 
assessment), presents the average proficiency for the three major fields, and 
summarizes the performance of subpopulations (gender, race/ethnicity, 
parents' educational level, Title I participation, and free/reduced lunch 
program eligibility) . To provide a context for the assessment data, 
participating students, their science teachers, and principals completed 
questionnaires which focused on: instructional content (curriculum coverage, 
amount of homework) ,* delivery of science instruction (availability of 
resources, type) ,* use of computers in science instruction,* educational 
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background of teachers; and conditions facilitating science learning (e.g., 
hours of television watched, absenteeism) . On the NAEP fields of science 
scales that range from 0 to 300, Arkansas students had an average proficiency 
of 144 compared to 148 throughout the United States. The average science 
scale score of males was higher than that of females in Arkansas; nationwide, 
however, the performance of males did not differ significantly from that of 
females. At the eighth grade, White students in Arkansas had an average 
science scale score that was higher than those of Black and Hispanic 
students. In Arkansas at grade 8, the average scale score of public school 
students (144) was lower than that of nonpublic school students (167) . 
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performance available to policymakers at the national, state, and local levels, NAEP is an integral part of our nation’s evaluation of the 
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HIGHLIGHTS 



^^onitoring the performance of students in subjects such as science is a key 
concern of the citizens, policy makers, and educators who direct educational reform 
efforts. The 1996 National Assessment of Educational Progress (NAEP) in science 
assesses the current level of science performance as a mechanism for informing 
education reform. This science assessment is the first to be constructed on a new 
framework, and it is also the first to be given at the state level. This report contains 
results for public and nonpublic school students at grade 8. 

What Is NAEP? 

The National Assessment of Educational Progress (NAEP), the “Nation’s Report 
Card,” is the only ongoing nationally representative assessment of what America’s 
students know and can do in various academic subjects. Since 1969, NAEP assessments 
have been conducted with national samples of students in the areas of reading, 
mathematics, science, writing, and other fields. By making information on student 
performance available to policy makers, educators, and the general public, NAEP is an 
integral part of our nation’s evaluation of the conditions and progress of education. 

NAEP is a congressionally mandated project of the National Center for Education 
Statistics, U.S. Department of Education. Results are provided only for group 
performance. NAEP is forbidden by law to report results at an individual or school 
level. 

In 1990 Congress authorized a voluntary state-by-state NAEP assessment. The 
1990 Trial State Assessment in mathematics at grade 8 was the first state-level NAEP 
assessment. Since then, state-level assessments have taken place in 1992 and 1994 in 
reading (grade 4), in 1992 and 1996 in mathematics (grades 4 and 8), and in 1996 in 
science (grade 8). In 1996, 44 states, the District of Columbia, Guam, and the 
Department of Defense Schools took part in the NAEP state assessment program. The 
NAEP 1996 state science assessment was at grade 8 only, although grades 4, 8, and 12 
were assessed at the national level as usual. 
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NAEP 1996 Science Assessment 

The NAEP 1996 science assessment was developed using a new framework. This 
framework was produced by educators, administrators, assessment experts, and 
curriculum specialists using a national consensus process. The framework was designed 
to reflect current practices in science teaching. It called for the use of multiple-choice 
questions and constructed-response questions that required both short and extended 
responses. The constructed-response questions served as indicators of students’ ability 
to know and integrate facts and scientific concepts, their ability to reason, and their 
ability to communicate scientific information. In the 1996 assessment, these 
constructed-response questions constituted nearly 80 percent of the total student response 
time. The NAEP 1996 assessment in science also included hands-on tasks that enabled 
students to demonstrate directly their knowledge and skills related to scientific 
investigation. 

The 1996 science framework was structured according to a matrix that consisted 
of the three traditional fields of science (earth, physical, and life) crossed with three 
processes of knowing and doing science (conceptual understanding, scientific 
investigation, and practical reasoning). A central category encompassing the nature of 
science and the nature of technology was woven throughout the assessment, as was a 
themes category representing major ideas or key concepts that transcend scientific 
disciplines. 1 

Students’ science performance is summarized on the NAEP science scales, which 
range from 0 to 300 at each grade. While the scale score ranges are identical for grades 
4, 8, and 12, the scales were derived independently at each grade. For example, scale 
scores on the grade 8 scale cannot imply anything about performance at grade 12 in the 
national assessment. The science scale is discussed in Appendix C of this report, the 
NAEP 1996 Science State Report for Arkansas (see C.9). Note that the national average 
for the combined public and nonpublic school population is 150; the average for public 
schools only (appropriate for most tables in this report) is 148. 

Comparison of Arkansas to the Nation 

Table H.1 shows the distribution of science scale scores for eighth-grade students 
attending public schools in Arkansas, the Southeast region, and the nation in 1996. See 
Chapter 2 (Table 2.6) of this report for the results for the nonpublic and the combined 
public and nonpublic school populations. 

• The average science scale score for eighth graders in public schools in 
Arkansas was 144. This average was lower than that for public school 
students across the nation (148). 2 
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1 More details about the NAEP 1996 science assessment can be found in Appendix B of this report, the NAEP 1996 
Science State Report for Arkansas. 

2 Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in the average science scale score between the two populations of 
interest. 
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TABLE H.1 


Distribution of Science Scale Scores for Public School 
Students at Grade 8 


State Assessment 



Average 


10th 


25th 


50th 


75th 


90th 


Scale Score 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



Arkansas 


144 ( 1.3) 


100 ( 2.6) 


123 ( 1.7) 


147 ( 1.8) 


168 ( 1.4) 


184 (2.1) 


Southeast 


141 ( 1.9) 


96 ( 2.9) 


118 (2.7) 


143(2.1) 


165 ( 1.9) 


183 ( 1 2) 


Nation 


148 ( 0.9) 


102 ( 1.6) 


126 ( 1.3) 


151 ( 0.9) 


172 ( 1.1) 


191 ( 1.3) 



The NAEP science scale ranges from 0 to 300. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1996 Science 
Assessment 



Major Findings for Student Subpopulations 

The preceding section provided a view of the overall science performance of 
eighth-grade students in Arkansas. It is also important to examine the average science 
scale scores of subgroups within the population. Typically, NAEP presents results for 
demographic subgroups defined by gender, race/ethnicity, and parental education. In 
addition, in 1996 NAEP collected information on student participation in two federally 
funded programs: Title I programs and the free/reduced-price lunch component of the 
National School Lunch Program. The 1996 state assessment in science also continues 
a component first introduced with the NAEP 1994 state assessment in reading — 
assessment of a representative sample of nonpublic school students. 

The reader is cautioned against using NAEP results to make simple or causal 
inferences related to subgroup membership. Differences among groups of students are 
almost certainly associated with a broad range of socioeconomic and educational factors 
not discussed in NAEP reports and possibly not addressed by the NAEP assessment 
program. 
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Results related to gender and race/ethnicity for public school students are 
highlighted below. A comparison of public and nonpublic school results is also 
presented. More complete results for the various demographic subgroups examined by 
the NAEP science assessment can be found in Chapter 2 of this report, the NAEP 1996 
Science State Report for Arkansas. 

• The average science scale score of males was higher than that of females 
in Arkansas; nationwide, however, the performance of males did not 
differ significantly from that of females. 

• At the eighth grade, White students in Arkansas had an average science 
scale score that was higher than those of Black and Hispanic students. 

• In Arkansas at grade 8, the average scale score of public school students 
(144) was lower than that of nonpublic school students (167). 

Finding a Context for Understanding Students’ Science Performance 
in Public Schools 

The science performance of students in Arkansas may be better understood when 
viewed in the context of the environment in which students are learning. This 
educational environment is largely determined by school policies and practices, by 
characteristics of science instruction in the school, by home support for academics and 
other home influences, and by students’ own views about science. Information about 
this environ m ent is gathered by means of questionnaires completed by principals and 
teachers as well as questions answered by students as part of the assessment. 

Because NAEP is administered to a sample of students that is representative of 
all eighth-grade students in Arkansas schools, NAEP results provide a view of the 
educational practices in Arkansas that may be useful for improving instruction and 
setting policy. However, despite the richness of context provided by the NAEP results, 
it is very important to note that NAEP data cannot establish a cause-and-effect 
relationship between educational environment and students’ scores on the NAEP science 
assessment. 
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The following results are for public school students: 



School Science Education Policies and Practices 3 

• In Arkansas, the percentage of eighth-grade students attending public 
schools that reported science was a priority (45 percent) was not 
significantly different from the percentage of eighth-grade students 
nationwide (43 percent). 

• Less than one fifth of the students in Arkansas had teachers who reported 
receiving all of the resources they needed for classroom instruction 
(15 percent). This was not significantly different from the 
corresponding percentage of eighth-grade students nationwide 
(11 percent). 

• In Arkansas, 30 percent of the eighth-grade students were taught by 
teachers who reported that there was a curriculum specialist available 
to help or advise them in science. This figure was smaller than that of 
students across the nation (43 percent). 

Science Classroom Practices 4 

• A large majority of the eighth-grade students in Arkansas had science 
teachers who reported spending a lot of time on earth science 
(89 percent), less than one fifth reported spending a lot of time on 
physical science (16 percent), and a small percentage reported spending 
a lot of time on life science (6 percent). 

• Relatively few of the students in Arkansas (9 percent) had teachers who 
reported they planned to place moderate emphasis on the understanding 
of key science concepts by their students. This percentage was smaller 
than that of students whose teachers planned heavy emphasis on 
conceptual understanding (91 percent). 



3 More detailed results related to school policies and practices can be found in Chapter 3 of this report, the NAEP 1996 
Science Slate Report for Arkansas. 

4 

More detailed results related to classroom practices can be found in Chapter 4 of this report, the NAEP 1996 Science 
State Report for A rkansas . 
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